Projet

Général

Profil

Scripts et taches planifiees » Historique » Version 47

Julien Enselme, 05/08/2013 16:05
Small corrections

1 1 Julien Enselme
Afin de gagner du temps et d'éviter les erreurs humaines, des scripts ont été écrits tout au long du projet. Certains sont même exécutés automatiquement toutes les semaines.
2
3 13 Florent Torregrosa
{{>toc}}
4 1 Julien Enselme
5
h1. Les tâches planifiées
6
7 26 Florent Torregrosa
h2. Crontab
8
9 3 Julien Enselme
Pour exécuter ces tâches régulièrement, on utilise le "crontab":http://fr.wikipedia.org/wiki/Crontab. Il s'agit d'un programme installé sur notre serveur.
10 1 Julien Enselme
11 3 Julien Enselme
Pour voir et modifier la liste des actions :
12
# se connecter au serveur : <code>ssh assos@sas1.centrale-marseille</code>
13
# taper la commande pour voir le crontab <code>crontab -l</code>
14 47 Julien Enselme
# taper la commande pour modifier le crontab <code>crontab -e</code>.
15 1 Julien Enselme
16 47 Julien Enselme
{{important(Ne pas effectuer cette opération avant de s'être renseigné sur "vi":http://fr.wikipedia.org/wiki/Vi (l'éditeur de texte utilisé qui n'est pas vraiment intuitif :p) et sur "la syntaxe du crontab":http://fr.wikipedia.org/wiki/Crontab#Modification !
17
Les scripts doivent si possible s’exécuter avant le club Drupal pour que les problèmes éventuels y soient réglés)}}
18
19
{{tip(Pour utiliser un autre éditeur que vi taper : export EDITOR=editor_name exemple : vim, nano)}}
20 26 Florent Torregrosa
21
<pre>
22
<code class="php">
23 42 Florent Torregrosa
######## How to use
24
# mm hh jj MMM JJJ task
25
# minutes hour day_month month day_week
26
# for more informations : https://fr.wikipedia.org/wiki/Crontab#Notation
27
######## End how to
28
29 43 Florent Torregrosa
### Traqu-heure
30
43 6 * * * /users/guest/assos/bin/traqu_heure/script-restitution.sh > /dev/null 2>&1 
31
0 * * * *  /users/guest/assos/bin/traqu_heure/script-traque.sh > /dev/null 2>&1 
32 1 Julien Enselme
33
34 43 Florent Torregrosa
### Cleaning
35
00 22 * * * /users/guest/assos/bin/all-reset-permissions.sh > /dev/null 2>&1
36
00 23 * * * /users/guest/assos/bin/delete-temporary-files.sh > /dev/null 2>&1
37 1 Julien Enselme
38
39 43 Florent Torregrosa
### Databases
40
# Create backup
41
00 21 * * 1 /users/guest/assos/bin/d7-all-dump-full.sh > /dev/null 2>&1
42
00 23 * * 1 /users/guest/assos/bin/d7-all-dump-individual.sh auto > /dev/null 2>&1
43
00 1 * * 2  /users/guest/assos/bin/d6-all-dump-full.sh > /dev/null 2>&1
44 42 Florent Torregrosa
45 43 Florent Torregrosa
# flush backup
46
00 21 * * 2 /users/guest/assos/bin/flush-full-databases-backups.sh d7 > /dev/null 2>&1
47
00 22 * * 2 /users/guest/assos/bin/flush-full-databases-backups.sh d6 > /dev/null 2>&1
48
00 23 * * 2 /users/guest/assos/bin/flush-individual-databases-backups.sh auto d7 > /dev/null 2>&1
49
00 1 * * 3  /users/guest/assos/bin/flush-individual-databases-backups.sh manual d7 > /dev/null 2>&1
50 42 Florent Torregrosa
51
52 43 Florent Torregrosa
### Updates for drupal 7
53
00 22 * * 3 /users/guest/assos/bin/d7-all-update-contrib.sh | mail -s "d7-all-update-contrib.sh" assos
54
00 1 * * 3  /users/guest/assos/bin/d7-all-update-localidation.sh | mail -s "d7-all-update-localidation.sh" assos
55
00 3 * * 3  /users/guest/assos/bin/d7-all-reset-variables.sh > /dev/null 2>&1  
56 42 Florent Torregrosa
57 44 Florent Torregrosa
00 5 * * 3  /users/guest/assos/bin/d7-all-releases-info.sh | mail -s "d7-all-releases-info.sh" assos
58 43 Florent Torregrosa
00 23 * * 4 /users/guest/assos/bin/d7-all-security-review.sh
59 42 Florent Torregrosa
60
61 43 Florent Torregrosa
# Updates for drupal 6
62
00 22 * * 6 /users/guest/assos/bin/d6-all-update-contrib.sh > /dev/null 2>&1
63
00 23 * * 6 /users/guest/assos/bin/d6-all-reset-variables.sh > /dev/null 2>&1 
64 42 Florent Torregrosa
65 43 Florent Torregrosa
# Launch drush cron on fellowings
66
45 17 * * *     /users/guest/assos/bin/drushcronone assos.centrale-marseille.fr.ginfo > /dev/null 2>&1 
67
*/15 * * * *    /users/guest/assos/bin/drushcronone assos.centrale-marseille.fr.clubfinance > /dev/null 2>&1
68
45 3 * * *      /users/guest/assos/bin/drushcronone default > /dev/null 2>&1 
69
35 00 * * *     /users/guest/assos/bin/drushcronone assos.centrale-marseille.fr.cac13 > /dev/null 2>&1 
70
*/45 * * * *    /users/guest/assos/bin/drushcronone assos.centrale-marseille.fr.expat > /dev/null 2>&1 
71 1 Julien Enselme
*/10 * * * *    /users/guest/assos/bin/drushcronone forum.centrale-marseille.fr > /dev/null 2>&1 
72 44 Florent Torregrosa
73
00 22 * * 7 /users/guest/assos/bin/disk-usage.sh | mail -s "disk-usage.sh" assos
74 1 Julien Enselme
75
</code>
76 25 Florent Torregrosa
</pre>
77 1 Julien Enselme
78 25 Florent Torregrosa
Voici la liste des tâches effectuées régulièrement.
79 3 Julien Enselme
80 25 Florent Torregrosa
h2. La réinitialisation des variables
81
82 1 Julien Enselme
Cette tâche consiste à réinitialiser certaines variables qui donnent des droits considérés comme trop permissifs donc dangereux aux administrateurs des sites ou nécessaire pour d'autres scripts tels que piwik ou security_review.
83
84 25 Florent Torregrosa
En voici quelques exemples :
85 1 Julien Enselme
86
<pre>
87
<code class="bash">
88 25 Florent Torregrosa
drush -y vset error_level 0
89
</code>
90 1 Julien Enselme
</pre>
91 21 Florent Torregrosa
92 25 Florent Torregrosa
Cette commande permet de ne pas afficher les messages d'erreurs. En effet, ils contiennent parfois des informations sensibles sur l'installation et ne doivent donc pas être divulgués à n'importe qui.
93
94 3 Julien Enselme
<pre>
95 1 Julien Enselme
<code class="php">
96
drush -y vset --always-set reverse_proxy TRUE
97 25 Florent Torregrosa
drush -y vset --always-set --format=json reverse_proxy_addresses '["147.94.19.16","147.94.19.17"]'
98 1 Julien Enselme
</code>
99 3 Julien Enselme
</pre>
100 1 Julien Enselme
101 3 Julien Enselme
Ces commandes permettent de déclarer à Drupal les serveurs proxy du CRI afin d'éviter qu'il ne répertorie tous les visiteurs comme ayant l'adresse des serveurs sus-cités. **Pas fini : voir http://assos.centrale-marseille.fr/content/t%C3%A2che/d%C3%A9clarer-les-proxy-du-cri-%C3%A0-drupal**
102 1 Julien Enselme
103 6 Julien Enselme
h2. La sauvegarde des bases de données
104 1 Julien Enselme
105 3 Julien Enselme
Sur les installations d6 et d7 : une fois par semaine
106 1 Julien Enselme
107 3 Julien Enselme
On utilise les [[Scripts_et_taches_planifiees#Tout-sauvegarder|scripts de sauvegarde créés par le club Drupal]].
108 1 Julien Enselme
109 3 Julien Enselme
h2. La purge des sauvegardes de bdd
110 1 Julien Enselme
111
Sur les installations d6 et d7 : toutes les semaines
112
113
Cette tâche utilise le script de [[Scripts_et_taches_planifiees#purge_des_sauvegardes.sh|purge des sauvegardes]] afin de libérer de l'espace disque en supprimant les sauvegardes de bdd les plus vieilles.
114
115
h1. Liste des scripts à disposition
116 21 Florent Torregrosa
117
Les scripts utilisés sont hébergés dans le répertoire bin du compte assos.
118
119
h2. all-reset-permissions.sh
120
121
<pre>
122
<code class="php">
123
#!/bin/sh
124
125
. scripts-config.sh
126
127
# This script puts the correct permissions to sites folders, settings.php and scripts.
128
129
######### drupal 6
130
for dir in `find $d6_dir_sites -type d -maxdepth 1 -mindepth 1 ! -name all ! -name images ! -name languages` ; do
131
    chmod 755 $dir
132
    chmod 400 $dir/settings.php
133
done
134
135
######### drupal 7
136
for dir in `find $d7_dir_sites -type d -maxdepth 1 -mindepth 1 ! -name all` ; do
137
    chmod 755 $dir
138
    chmod 400 $dir/settings.php
139 35 Florent Torregrosa
done
140
141
####### bin
142
chmod -R 700 $dir_scripts
143
144
####### backup
145 21 Florent Torregrosa
chmod -R 700 $dir_backup
146
147
####### log
148 1 Julien Enselme
chmod -R 700 $dir_log
149 21 Florent Torregrosa
</code>
150
</pre>
151
152
h2. contrib-usage.sh
153
154
<pre>
155
<code class="php">
156
#!/bin/sh
157
158
. scripts-config.sh
159 29 Florent Torregrosa
. scripts-utils.sh
160 21 Florent Torregrosa
161
# ARGS: Drupal_version, project_status, project_name
162
# List sites that have the project_name with the corresponding project_status.
163
# project status: enabled or disabled
164
165
check_arguments $# 3
166
167
if [ $1 = d6 ] ; then
168
    cd $d6_dir_sites
169 41 Florent Torregrosa
else
170 21 Florent Torregrosa
    cd $d7_dir_sites
171
fi
172
173
for dir in `find . -maxdepth 1 -mindepth 1 -type d ! -name all ! -name languages ! -name images | sort ` ; do
174
    # List non-core projects that correspond to the status.
175
    # Keep project_name if listed.
176
    # Count line result. 0 if not listed or 1 if listed.
177
	# Print site_dir if listed.
178
179 29 Florent Torregrosa
    cd $dir;
180 21 Florent Torregrosa
	if [ 1 -eq `drush pml --no-core --status=$2 | grep $3 | wc -l` ] ; then
181
        echo $dir; 
182
    fi
183
    cd -
184 1 Julien Enselme
done
185 21 Florent Torregrosa
</code>
186
</pre>
187
188
h2. d6-all-drush.sh
189
190
<pre>
191
<code class="php">
192
#!/bin/sh
193
194
. scripts-config.sh
195
. scripts-utils.sh
196
197 41 Florent Torregrosa
# ARGS: drush_command
198 21 Florent Torregrosa
199
check_arguments $# 1
200
201
for dir in `find $d6_dir_sites -maxdepth 1 -mindepth 1 -type d ! -name all ! -name languages ! -name images | sort` ; do
202
    cd $dir
203
    echo $dir
204
    drush $*
205 1 Julien Enselme
done
206 21 Florent Torregrosa
</code>
207
</pre>
208
209
h2. d6-all-dump-full.sh
210
211
<pre>
212
<code class="php">
213
#!/bin/sh
214
215
. scripts-config.sh
216
217
current_date=`date "+%Y-%m-%d-%Hh%Mm%Ss"`
218
219
# Dump D6 database with webassos user.
220 45 Florent Torregrosa
mysqldump --single-transaction webassos -h myweb.serv.int -u webassos --password=password > $d6_dir_full_backup/webassos/$current_date.webassos.sql
221 21 Florent Torregrosa
222
# Dump D6 form database with forum user.
223 45 Florent Torregrosa
mysqldump forum -h myweb.serv.int -u forum --password=password > $d6_dir_full_backup/forum/$current_date.forum.sql
224 37 Florent Torregrosa
</code>
225
</pre>
226
227
h2. d6-all-reset-variables.sh
228
229
<pre>
230
<code class="php">
231
#!/bin/sh
232
233
. scripts-config.sh
234 41 Florent Torregrosa
235 37 Florent Torregrosa
cd $d6_dir_sites
236
d6-all-drush.sh vset --always-set reverse_proxy TRUE
237 39 Florent Torregrosa
d6-all-drush.sh vset --always-set --format=json reverse_proxy_addresses '["147.94.19.16","147.94.19.17"]'
238 1 Julien Enselme
drush @sites -y ev "variable_set('update_notify_emails', array('@email_multi_assos'));"
239 21 Florent Torregrosa
</code>
240
</pre>
241
242
h2. d6-all-update-contrib.sh
243
244
<pre>
245
<code class="php">
246
#!/bin/sh
247
248
. scripts-config.sh
249
250
d6-all-drush.sh -y en update
251
# Launch cron to check for updates.
252
d6-all-drush.sh -q cron
253
254
d6-all-drush.sh cc all
255
d6-all-dump-full.sh
256
257
d6-all-drush.sh -y upc --no-core
258
d6-all-drush.sh -y updb
259
260
d6-all-drush.sh -y dis update
261
262 1 Julien Enselme
d6-all-drush.sh cron
263 21 Florent Torregrosa
</code>
264
</pre>
265
266
h2. d6-dump-individual.sh
267
268
<pre>
269 1 Julien Enselme
<code class="php">
270
#!/bin/sh
271
272
. scripts-config.sh
273
274
# ARGS: auto or manual, site_prefix
275 41 Florent Torregrosa
# WARNING : backup are regularly flushed, put your backup in a safe place.
276
277
cd $dir_individual_backup
278
279
#!/bin/sh
280
281
. scripts-config.sh
282
283
# ARGS: auto or manual, site_prefix
284 21 Florent Torregrosa
# WARNING : backup are regularly flushed, put your backup in a safe place.
285
286
cd $dir_individual_backup
287
288
#récupération des tables du site dans le fichier liste_tables.temp
289 1 Julien Enselme
tables='_%'
290
liste="$1$tables"
291
292
mysql -h myweb.serv.int -u webassos --password=HBVH2ljgyZCA0AP251DY -BNe "show tables like '"$liste"'" webassos | tr '\r\n' ' ' > liste_tables.temp
293 21 Florent Torregrosa
294 1 Julien Enselme
#transformation de cette liste en une variable
295 21 Florent Torregrosa
var=$(cat liste_tables.temp)
296
297
#sauvegarde de toutes ces tables
298
current_date=`date "+%Y-%m-%d-%Hh%Mm%Ss"`
299 41 Florent Torregrosa
suffixe="_dump$current_date.sql"
300
fichier="$1$suffixe"
301
302
if [ $1 = 'auto' ] ; then
303 21 Florent Torregrosa
    mysqldump webassos -h myweb.serv.int -u webassos --password=HBVH2ljgyZCA0AP251DY $var > $d6_dir_individual_auto_backup/$fichier
304
else
305
    mysqldump webassos -h myweb.serv.int -u webassos --password=HBVH2ljgyZCA0AP251DY $var > $d6_dir_individual_manual_backup/$fichier
306
fi
307
308 1 Julien Enselme
#suppression du fichier temporaire utilisé
309 21 Florent Torregrosa
rm liste_tables.temp
310
</code>
311
</pre>
312
313 1 Julien Enselme
h2. d7-all-drush-logged.sh
314 21 Florent Torregrosa
315
<pre>
316
<code class="php">
317
#!/bin/sh
318
319
. scripts-config.sh
320
. scripts-utils.sh
321
322 30 Florent Torregrosa
# ARGS: drush_command
323
324 41 Florent Torregrosa
check_arguments $# 1
325 1 Julien Enselme
326
cd $d7_dir_sites
327 30 Florent Torregrosa
328
for dir in `find . -maxdepth 1 -mindepth 1 -type d ! -name all | sort` ; do
329
    cd $dir
330 21 Florent Torregrosa
    current_date=`date "+%Y-%m-%d_%Hh:%Mm"`
331 30 Florent Torregrosa
    echo "======$current_date======" >> $d7_dir_log/$dir.log
332
    echo "Arguments are: $* " >> $d7_dir_log/$dir.log
333 21 Florent Torregrosa
    drush $* >> $d7_dir_log/$dir.log
334
    #To have the same caracters limit we needed 'end' that have 4 caracters, we used the Croate language for this ! LOL 
335
    echo -e "=============KRAJ=============\n" >> $d7_dir_log/$dir.log
336 1 Julien Enselme
    cd -
337 21 Florent Torregrosa
done
338 1 Julien Enselme
</code>
339 21 Florent Torregrosa
</pre>
340
341
h2. d7-all-drush.sh
342
343
<pre>
344
<code class="php">
345
#!/bin/sh
346
347
. scripts-config.sh
348
. scripts-utils.sh
349
350 41 Florent Torregrosa
# ARGS: drush_command
351 21 Florent Torregrosa
352
check_arguments $# 1
353
354
for dir in `find $d7_dir_sites -maxdepth 1 -mindepth 1 -type d ! -name all | sort` ; do
355
    cd $dir
356
    echo $dir
357
    drush $*
358 1 Julien Enselme
done
359 21 Florent Torregrosa
</code>
360
</pre>
361
362
h2. d7-all-dump-full.sh
363
364
<pre>
365
<code class="php">
366
#!/bin/sh
367
368
. scripts-config.sh
369
370
current_date=`date "+%Y-%m-%d-%Hh%Mm%Ss"`
371
372
# Dump D7 databases at once.
373 45 Florent Torregrosa
mysqldump -h $db_server -u $db_user -ppassword --all-databases > $d7_dir_full_backup/myassos/$current_date.d7_full.sql
374 21 Florent Torregrosa
</code>
375
</pre>
376
377
h2. d7-all-dump-individual.sh
378
379
<pre>
380
<code class="php">
381
#!/bin/sh
382
383
. scripts-config.sh
384
385 34 Florent Torregrosa
# ARGS: auto or manual
386
387
current_date=`date "+%Y-%m-%d-%Hh%Mm%Ss"`
388 21 Florent Torregrosa
389
cd $d7_dir_sites
390
391
for dir in `find . -maxdepth 1 -mindepth 1 -type d ! -name all | cut -c3-` ; do
392
    cd $dir
393 40 Florent Torregrosa
    drush cc all
394 1 Julien Enselme
    if [ $1 = 'auto' ] ; then
395 34 Florent Torregrosa
        drush sql-dump --result-file="$d7_dir_individual_auto_backup/$dir/$current_date.$dir.sql"
396 21 Florent Torregrosa
    else
397
        drush sql-dump --result-file="$d7_dir_individual_manual_backup/$dir/$current_date.$dir.sql"
398
    fi
399
    cd -
400 1 Julien Enselme
done
401 21 Florent Torregrosa
</code>
402
</pre>
403
404
h2. d7-all-releases-info.sh
405
406
<pre>
407
<code class="php">
408
#!/bin/sh
409
410
. scripts-config.sh
411
412 28 Florent Torregrosa
# List version of a module or theme that exists in sites/all/*
413
# and all versions that are available for same project on drupal.org
414
415
# modules
416
cd $d7_dir_sites/all/modules
417 1 Julien Enselme
for dir in `ls -1` ; do
418
    if [ -d $dir ] ; then
419 28 Florent Torregrosa
        drush pm-releases $dir
420
    fi
421
done
422
423
# themes
424 1 Julien Enselme
cd $d7_dir_sites/all/themes
425 21 Florent Torregrosa
for dir in `ls -1` ; do
426
    if [ -d $dir ] ; then
427
        drush pm-releases $dir
428
    fi
429 1 Julien Enselme
done
430 21 Florent Torregrosa
</code>
431
</pre>
432
433
h2. d7-all-reset-variables.sh
434
435
<pre>
436
<code class="php">
437 41 Florent Torregrosa
#!/bin/sh
438 21 Florent Torregrosa
439
. scripts-config.sh
440
441
for dir in `find $d7_dir_sites -maxdepth 1 -mindepth 1 -type d ! -name all | sort` ; do
442
    cd $dir
443
    echo $dir
444
    d7-reset-variables.sh
445 1 Julien Enselme
done
446 21 Florent Torregrosa
</code>
447
</pre>
448
449
h2. d7-all-security-review.sh
450
451
<pre>
452
<code class="php">
453
#!/bin/sh
454
455
. scripts-config.sh
456
457
# grep -v success to keep site_name and error lines.
458 1 Julien Enselme
bash -c 'd7-all-drush.sh security-review |& grep -v success | mail -s "Security review" $email_multi_assos'
459 21 Florent Torregrosa
</code>
460
</pre>
461
462
h2. d7-all-update-contrib.sh
463 1 Julien Enselme
464 21 Florent Torregrosa
<pre>
465
<code class="php">
466
#!/bin/sh
467
468
. scripts-config.sh
469
470
d7-all-drush.sh -y en update
471
# Launch cron to check for updates.
472
d7-all-drush.sh -q cron
473
474
d7-all-drush.sh cc all
475
d7-all-dump-individual.sh
476
477
d7-all-drush-logged.sh -y upc --no-core
478 41 Florent Torregrosa
d7-all-drush.sh -y updb
479 21 Florent Torregrosa
480
d7-all-drush.sh -y dis update
481
482 1 Julien Enselme
d7-all-drush.sh cron
483 21 Florent Torregrosa
</code>
484
</pre>
485
486
h2. d7-all-update-localisation.sh
487
488
<pre>
489
<code class="php">
490
#!/bin/sh
491
492
. scripts-config.sh
493
494
d7-all-drush.sh -y en l10n_update
495
d7-all-drush.sh l10n-update-refresh
496
d7-all-drush.sh l10n-update
497 1 Julien Enselme
d7-all-drush.sh -y dis l10n_update
498 21 Florent Torregrosa
</code>
499
</pre>
500
501
h2. d7-create-site.sh
502
503 1 Julien Enselme
<pre>
504 21 Florent Torregrosa
<code class="php">
505
#!/bin/sh
506
507
. scripts-config.sh
508
. scripts-config-site.sh $1
509
. scripts-utils.sh
510
511
# ARGS: site name
512
513 31 Julien Enselme
######## Exceptions
514 21 Florent Torregrosa
check_arguments $# 1
515
516
# "-" is forbidden because it provokes database error.
517
if [ `echo $1 | grep -` ] ; then
518
    echo '"-" is forbidden in the site name'
519 41 Florent Torregrosa
    exit 1
520 21 Florent Torregrosa
fi
521
522
# Site name length must be lower or equal to 16 due to database limitations.
523
if [`echo $1 | wc -c` -gt 16 ] ; then
524
    echo "site name can't have more than 16 characters"
525
    exit 1
526
fi
527 31 Julien Enselme
528 21 Florent Torregrosa
###### Initialisation
529
cd $d7_dir
530
db_password=`ask_password_db $db_server $db_user`
531
site_password=`generate_password`
532
533
# Check if site database already exists.
534
if mysql -h $db_server -u $db_user -e "USE $d7_site_name" -p$db_password 2>/dev/null ; then
535
    echo "Database $d7_site_name already exists"
536
    exit 1
537
fi
538
539
# Check if site folder already exists.
540 1 Julien Enselme
if [ -d $d7_site_dir ] ; then
541 21 Florent Torregrosa
    echo "Folder $d7_site_dir already exists"
542 1 Julien Enselme
    exit 1
543 31 Julien Enselme
fi
544 1 Julien Enselme
545
###### Main
546 31 Julien Enselme
mkdir $d7_site_dir
547
dir_site_name="assos.centrale-marseille.fr.$d7_site_name"
548 21 Florent Torregrosa
549
# Backup requirements
550 31 Julien Enselme
mkdir $d7_dir_individual_auto_backup/$dir_site_name
551
mkdir $d7_dir_individual_manual_backup/$dir_site_name
552
current_date=`date "+%Y-%m-%d-%Hh%Mm%Ss"`
553
554 21 Florent Torregrosa
# NB : ls sort by considering the 1st characters
555
touch $d7_dir_individual_auto_backup/$dir_site_name/$current_date.$dir_site_name.sql
556
touch $d7_dir_individual_auto_backup/$dir_site_name/$current_date.$dir_site_name.sql2
557
touch $d7_dir_individual_auto_backup/$dir_site_name/$current_date.$dir_site_name.sql3
558
559
# Create and grant privileges on database
560
mysql -h $db_server -u $db_user -e "CREATE DATABASE $d7_site_name" -p$db_password
561
mysql -h $db_server -u $db_user -e "GRANT ALL PRIVILEGES ON $d7_site_name.* TO '$d7_site_name'@'%' IDENTIFIED BY '$site_password'" -p$db_password
562
563
# Create settings.php
564
sed "s/\%\%DBUSER\%\%/$d7_site_name/ ; s/\%\%DBNAME\%\%/$d7_site_name/ ; s/\%\%DBPASS\%\%/$site_password/ ; s/\%\%nomsite\%\%/$d7_site_name/" < $d7_settings_template > $d7_site_settings
565
566
# Create symbolic link
567
cd $d7_dir
568
ln -s . $d7_site_name
569
570
# Next Instructions
571
echo "Go to http://assos.centrale-marseille.fr/$d7_site_name/install.php to continue."
572
echo "Press enter when ready to go on."
573
read key
574
575
# Init variables
576
d7-reset-variables.sh $d7_site_name
577
578
# Permissions
579
chmod -R 755 $d7_site_dir
580
chmod 400 $d7_site_settings
581
582
# Last instructions
583
echo "Last instructions:"
584
echo "- Advice the webmaster to close account creation on the website"
585
echo "- Give the webmaster a link to the club Drupal's tutorials "
586
echo "- Create a node of type \"Site\" on default"
587 1 Julien Enselme
echo "- Register the webmaster on webmasters@listes.centrale-marseille.fr"
588 21 Florent Torregrosa
</code>
589
</pre>
590
591
h2. d7-delete-site.sh
592
593
<pre>
594
<code class="php">
595
#!/bin/sh
596
597
. scripts-config.sh
598
. scripts-config-site.sh $1
599
. scripts-utils.sh
600
601
# ARGS: site name.
602
603
check_arguments $# 1
604 38 Julien Enselme
605 21 Florent Torregrosa
db_password=`ask_password_db $db_server $db_user`
606
607
# Delete database.
608
mysql -h $db_server -u $db_user -p$db_password -e "DROP DATABASE $d7_site_name"
609
610
# Delete MYSQL user.
611
mysql -h $db_server -u $db_user -p$db_password -e "DROP USER '$d7_site_name'@'%'"
612
613
# Delete site's folder.
614
chmod -R 700 $d7_site_dir
615
rm -r $d7_site_dir
616
617
# Delete symbolic link.
618
rm $d7_dir/$d7_site_name
619
620
# Delete database backups.
621
rm -r $d7_dir_individual_auto_backup/assos.centrale-marseille.fr.$d7_site_name
622
rm -r $d7_dir_individual_manual_backup/assos.centrale-marseille.fr.$d7_site_name
623
624
echo "Don't forget to:"
625 1 Julien Enselme
echo "- Refresh node site on default"
626 21 Florent Torregrosa
echo "- Check particular behavior (normally detailed on site node)"
627
</code>
628
</pre>
629 1 Julien Enselme
630 21 Florent Torregrosa
h2. d7-reset-variables.sh
631 1 Julien Enselme
632 21 Florent Torregrosa
<pre>
633
<code class="php">
634
#!/bin/sh
635
636
. scripts-config.sh
637
638
# ARGS: [site_name]
639
640
if [ ! -z $1 ] ; then
641
    . scripts-config-site.sh $1
642
    cd $d7_site_dir
643
fi
644
645
current_timestamp=`date "+%s"`
646 41 Florent Torregrosa
647 46 Florent Torregrosa
random_1=`dd if=/dev/urandom count=1 2> /dev/null | cksum | cut -f1 -d" "`
648
random_2=`dd if=/dev/urandom count=1 2> /dev/null | cksum | cut -f1 -d" "`
649
650 21 Florent Torregrosa
####### General variables
651 41 Florent Torregrosa
drush -y vset --always-set reverse_proxy TRUE
652 21 Florent Torregrosa
drush -y vset --always-set --format=json reverse_proxy_addresses '["147.94.19.16","147.94.19.17"]'
653
drush -y ev "variable_set('update_notify_emails', array('@email_multi_assos'));"
654
drush -y vset error_level 0
655
drush -y vset dblog_row_limit 1000
656
657
###### Hidden captcha
658
drush -y en hidden_captcha
659
# Log wrong answers.
660
drush -y vset captcha_log_wrong_responses 1
661
# Use hidden captcha for all forms.
662 1 Julien Enselme
drush -y sqlq --db-prefix "UPDATE {captcha_points} SET module = 'hidden_captcha', captcha_type = 'Hidden CAPTCHA' WHERE module is NULL;"
663
# Flush captcha cache.
664 21 Florent Torregrosa
drush -y vdel captcha_placement_map_cache
665 1 Julien Enselme
# Randomely generate a math question as the label of the hidden captcha field.
666 46 Florent Torregrosa
drush -y vset hidden_captcha_label "$random_1 + $random_2"
667 1 Julien Enselme
668
669 21 Florent Torregrosa
####### Piwik
670
drush -y en piwik
671
drush -y vset piwik_site_id "101"
672
drush -y vset piwik_url_http "http://piwik.centrale-marseille.fr/"
673
drush -y vset piwik_url_https "https://piwik.centrale-marseille.fr/"
674 32 Julien Enselme
# Piwik cache.
675 33 Julien Enselme
drush -y vset piwik_cache 1
676 21 Florent Torregrosa
drush -y vset piwik_visibility_roles "1"
677
# Piwik is enable for everyone except the administrator
678
drush -y vset --format=json piwik_roles '[3]'
679
drush -y vset piwik_page_title_hierarchy 1
680
# Activate local search.
681
drush -y vset piwik_site_search 1
682 41 Florent Torregrosa
683
684
###### Security review
685 21 Florent Torregrosa
# For untrusted roles:
686
# 1: anonymous user
687
# 2: authenticated user
688 41 Florent Torregrosa
# 3: administrator
689
drush -y en security_review
690
drush -y ev "variable_set('security_review_untrusted_roles', array('1'));"
691 21 Florent Torregrosa
# Security review can't check for files permissions on multi_assos.
692
# TODO: the database scheme does'nt exist until security_review is run for the first time. Even with the scheme there are sql error.
693
# drush -y sqlq "UPDATE {security_review} SET skip = '1', skiptime = $current_timestamp, skipuid = '1' WHERE reviewcheck IN ('file_perms');"
694 1 Julien Enselme
# drush -y sqlq "UPDATE {security_review} SET skip = '0', skiptime = '0', skipuid = NULL WHERE reviewcheck NOT IN ('file_perms');"
695 21 Florent Torregrosa
</code>
696
</pre>
697
698
h2. delete-temporary-files.sh
699
700
<pre>
701
<code class="php">
702
#!/bin/sh
703
704
. scripts-config.sh
705
706 1 Julien Enselme
find $dir_multi_assos -name '*~' -delete
707 21 Florent Torregrosa
</code>
708
</pre>
709
710
h2. disk-usage.sh
711
712
<pre>
713
<code class="php">
714
#!/bin/sh
715
716
. scripts-config.sh
717
718 1 Julien Enselme
echo -e "Quotas: 9.1 GB\n"
719
720
echo "Assos:"
721
du -hcs $dir_multi_assos | grep total
722
echo -e "\n"
723
724
echo "D6:"
725
cd $d6_dir_sites
726
du -h -d 1
727
echo -e "\n"
728
729
echo "D7:"
730
cd $d7_dir_sites
731
du -h -d 1
732
echo -e "\n"
733
734
echo "Logs:"
735
du -hcs $dir_log | grep total
736
echo -e "\n"
737 21 Florent Torregrosa
738
echo "Backups:"
739
cd $dir_backup
740 41 Florent Torregrosa
du -h -d 2
741
</code>
742
</pre>
743
744
h2. drushcronone
745
746
<pre>
747
<code class="php">
748
#!/bin/sh
749
750
. scripts-config.sh
751
752
if [ $# -lt 1 ]; then
753
  echo "usage: $0 <site's folder name>"
754
  exit 1
755
fi
756
757
cd "$d6_sites_dir/$*"
758
pwd;
759 1 Julien Enselme
drush cron;
760 21 Florent Torregrosa
</code>
761
</pre>
762
763
h2. flush-files.sh
764
765
<pre>
766
<code class="php">
767
#!/bin/sh
768
769
# ARGS: number of files to keep, email address
770
# usage: flush files from a folder except a number equal to argument.
771
772
# Check if scripts-config.sh is imported.
773
if [ -z $scripts_utils ] ; then
774
    echo "Import of scripts-utils.sh required."
775
    exit 1
776
fi
777
778
check_arguments $# 2
779
780
backups_number=`ls | wc -l`
781 1 Julien Enselme
let "number_of_backups_to_delete = backups_number - $1"
782 21 Florent Torregrosa
783
if [ $number_of_backups_to_delete -gt 0 ] ; then
784
    ls | head -$number_of_backups_to_delete | xargs rm
785
else
786
    dir=`pwd`
787
    echo "There are not enough files in $dir to Flush it. Check if backup script works fine." | mail -s "[db] $dir has a backup problem" $2
788
fi
789 1 Julien Enselme
</code>
790 21 Florent Torregrosa
</pre>
791
792
h2. flush-full-databases-backups.sh
793
794
<pre>
795
<code class="php">
796
#!/bin/sh
797
798
. scripts-config.sh
799
800
# ARGS: Drupal version
801
802
cd $dir_full_backup/$1
803 41 Florent Torregrosa
804 21 Florent Torregrosa
for dir in `ls` ; do
805 1 Julien Enselme
    cd $dir
806 21 Florent Torregrosa
    flush-files.sh $db_full_backup_number $email_multi_assos
807
    cd -
808
done
809 1 Julien Enselme
</code>
810 21 Florent Torregrosa
</pre>
811
812
h2. flush-individual-databases-backups.sh
813
814
<pre>
815
<code class="php">
816
#!/bin/sh
817
818
. scripts-config.sh
819
820
# ARGS: manual or auto, Drupal version
821
822
cd $dir_individual_backup/$1/$2
823
824
for dir in `ls` ; do
825
    cd $dir
826
    if [ $1 = 'auto' ] ; then
827 41 Florent Torregrosa
        flush-files.sh $db_individual_auto_backup_number $email_multi_assos
828 21 Florent Torregrosa
    else
829
        flush-files.sh $db_individual_manual_backup_number $email_multi_assos
830
    fi
831 1 Julien Enselme
    cd -
832 21 Florent Torregrosa
done
833
</code>
834
</pre>
835
836
h2. scripts-config-site.sh
837
838
<pre>
839
<code class="php">
840
#!/bin/sh
841
842
# Sets useful variables of a site.
843
# ARGS: site_name
844
# Requires scripts-config.sh
845
846
# Check if scripts-config.sh is imported.
847
if [ -z $scripts_config ] ; then
848
    echo "Import of scripts-config.sh required."
849
    exit 1
850
fi
851
852
if [ -z $1 ] ; then
853 1 Julien Enselme
    echo "This script needs a site name as argument."
854 21 Florent Torregrosa
    exit 1
855
fi
856
857
scripts_config_site='imported'
858
859
d7_site_name=$1
860
d7_site_dir="$d7_dir_sites/assos.centrale-marseille.fr.$d7_site_name"
861 1 Julien Enselme
d7_site_settings="$d7_site_dir/settings.php"
862 21 Florent Torregrosa
</code>
863
</pre>
864
865
h2. scripts-config.sh
866
867
<pre>
868
<code class="php">
869
#!/bin/sh
870
871
PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/games:/usr/local/sbin:/usr/local/bin:/users/guest/assos/bin
872
PATH=$PATH:/usr/guest/assos/bin
873
874
scripts_config='imported'
875
876 41 Florent Torregrosa
email_multi_assos="assos@centrale-marseille.fr"
877 21 Florent Torregrosa
878
dir_multi_assos='/users/guest/assos'
879
dir_scripts="$dir_multi_assos/bin"
880
dir_template="$dir_multi_assos/template"
881
882
###### Database
883
db_server="myassos.serv.int"
884
db_user="assos"
885
dir_log="$dir_multi_assos/log"
886
887
###### Backup
888
db_full_backup_number=3
889
db_individual_manual_backup_number=3
890
db_individual_auto_backup_number=3
891
892
dir_backup="$dir_multi_assos/backup"
893
dir_full_backup="$dir_backup/full"
894
dir_individual_backup="$dir_backup/individual"
895
dir_individual_manual_backup="$dir_individual_backup/manual"
896
dir_individual_auto_backup="$dir_individual_backup/auto"
897
898
899
###### D7 variables
900
d7_dir="$dir_multi_assos/htmltest"
901
d7_dir_sites="$d7_dir/sites"
902
903
### Log
904
d7_dir_log="$dir_log/d7"
905
906
### Backup
907
d7_dir_full_backup="$dir_full_backup/d7"
908
d7_dir_individual_manual_backup="$dir_individual_manual_backup/d7"
909
d7_dir_individual_auto_backup="$dir_individual_auto_backup/d7"
910
911
### Template
912
d7_settings_template_name="settings-D7-bddinde-template.php"
913
d7_settings_template="$dir_template/$d7_settings_template_name"
914
915
916
###### D6 variables
917
d6_dir="$dir_multi_assos/html"
918 1 Julien Enselme
d6_dir_sites="$d6_dir/sites"
919 21 Florent Torregrosa
920
### Backup
921
d6_dir_full_backup="$dir_full_backup/d6"
922 1 Julien Enselme
d6_dir_individual_manual_backup="$dir_individual_manual_backup/d6"
923
d6_dir_individual_auto_backup="$dir_individual_auto_backup/d6"
924 21 Florent Torregrosa
</code>
925
</pre>
926
927
h2. scripts-utils.sh
928
929
<pre>
930
<code class="php">
931
#!/bin/sh
932 1 Julien Enselme
933 21 Florent Torregrosa
# This script contains useful functions for other scripts.
934
935
# Check if scripts-config.sh is imported.
936
if [ -z $scripts_config ] ; then
937
    echo "Import of scripts-config.sh required."
938
    exit 1
939
fi
940
941
scripts_utils='imported'
942
943
ask_password() {
944
    # read -s doesn't work with sh.
945 1 Julien Enselme
    # usage: pass=`ask_password "password please:"`
946 41 Florent Torregrosa
    echo $1 >&2
947 21 Florent Torregrosa
    echo -n ">" >&2
948 41 Florent Torregrosa
    stty_avant=`stty -g`
949
    stty -echo
950 21 Florent Torregrosa
    read password
951
    stty $stty_avant
952
    echo "$password"
953
    unset password
954
}
955
956
ask_password_db() {
957
    # ARGS: server_name, user_name
958 1 Julien Enselme
    local db_password="pour_boucler"
959 41 Florent Torregrosa
    # empty db request to validate password
960 21 Florent Torregrosa
    while ! mysql -h $1 -u $2 -p$db_password -e "" 2>/dev/null ; do
961
        db_password=`ask_password "database password:"`
962
    done
963
    echo $db_password
964
}
965
966
generate_password(){
967
    # ARGS: [password_length]
968
    # The password contains special characters. '/' must be excluded to avoid sed malfunction.
969
970
    local site_password='/'
971
972
    if [ -z $1 ] ; then
973 41 Florent Torregrosa
        local password_length=20
974 21 Florent Torregrosa
    else
975
        local password_length=$1
976
    fi
977
978
    while echo "$site_password" | grep -Fq '/' ; do
979
        site_password=`dd if=/dev/urandom count=1 | uuencode -m - | head -n 2 | tail -n 1 | cut -c-$password_length`
980
    done
981
982
    echo $site_password
983
}
984
985
count_d7_sites(){
986
    find $d7_dir_sites -type d ! -name all -maxdepth 1 | wc -l
987 41 Florent Torregrosa
}
988 21 Florent Torregrosa
989
check_arguments() {
990
    # ARGS: number of arguments passed to script, number of arguments required
991 11 Julien Enselme
    if [ $1 -lt $2  ] ; then
992
        echo "Number of arguments insuffisant."
993 1 Julien Enselme
        exit 1
994
    fi
995
}
996
</code>
997
</pre>